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SYSTEM AND METHOD POR MEASURING QUALITY OP SERVICE 



BACKGROUND OF THE INVENTION 

1. Field uf the Iuveulion 

The present invention relates to techniques of measuring 
quality of service (QoS), and in particular to a system 
and method of measuring QoS that, a network sucti as TP{TntArnAf 
5 Protocol) based network provides to a stream of data blocks 
traveling from a source to a destination over tne networx. 
[V 2. Description of the Related Art 

There has been proposed a QoS measuring system which 
captures user's data currently traveling over a network 
10 to measure QoS, achieving passive and real- time QoS measuring. 
Since QoS -measuring data is not transmitted to the network, the 
load on the network can be avoided from incrca3±ng due to extra 
data transmission. 

An example of such a QoS measuring system is disclosed 
13 in Japanese PaLeaL Application Unexamined publication No. 
<3-2fi1?54. More specifically, video data is transmitted in 
fixed-length packets (cells) from a data source to a remote data 
receiver via a network in which a connection has been established. 
To meacurc QoS of the connection provided by the network, firot 
20 and second monitorinq devices are connected to a first link 
connecting the data source to an ingress of the network and a 
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second link connecting an egres9 of the network to the remote 
data receiver, respectively. 

The firs I monitoring device time-stamps a captured inflow 
eel 1 to produce inflow o«l 1 information and sends i t to 
5 a measuring station. Similarly, the second monitoring device 
time-stamps a captured outtiow cell to produce outtlow ceil 

information and sonde it to the measuring station. 

The measuring station forms an Inbound queue of inflow 
cell information and an outbound queue of outflow inflow 
^ 10 inf uLiualiun lu search fox a malchiuy pail . The iiidLuhiay is 

2 performed by comparing the first piece of cell information of 

tU one queue with each of the first N pieces of cell information 

\| ot the other queue. When a matching pair is found, it means that 

««s an inflow ocll successfully travels over the connection of 

:.. 15 the network to the eqress thereof, When no matchinq pair is 

RSSS 

y found, it is determined that an inflow cell has been lost or 

Irreparably destroyed. 

Tn the ahovp.-dp.srri hed conventional QoS me^snri ng system, 
it is apparently assumed that a fixed connection is established 

20 between predetermined ingress and egress ot the network, in 
other words, this prior art ic predicated on point-to-point 
real-time communication from the video data source including 
a video camera to the remote video receiver including a 
video monitor. Accordingly, if the video data source 

25 communicates with another remote video receiver that is 

installed at a different location and i3 connected to a different 
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egress of the network, the system cannot measure the Qos of the 
communication because a matching pair cannot be detected in tha 
inbound end outbound queues, resulting in loss o£ cell eveui. 
Howavat-, in TP-hasftd data nAfrworlcs snrh as thft Tnrp.rnAt, 
5 each IP packet has destination and source IP addresses and each 
router determines the next hop depending on the IP addresses 
to forward it to its destination. Therefore, the ingress and 
eqress of the network are not always fixed, in addition, a 
server may transmit information to a plurality of clients and may 
10 receive iufuxiuaLiua fium a plurality of clients, fur example, 
J5 in the rase of HTTP (Hyper Text Transfer Protocol) . Therefore. 

a combination of the ingress and egress of the network may vary 
tor each packet. 

When the above -described conventional QoS measuring 
15 system is applied to such IP-based network, typically the 
Internet, a lot of pieces of cell information having no match 
will be included in the inbound and outbound queues. If such 
a lot. of p1 p.r.fts of r.All information is aocommodat p.ri , a larg* 
amount of memory is needed in the measuring station and further 

20 a lot of time is required tor searching, 

As known well, lose of packet ie critical to QoS measuring . 
If the loss of packet is erroneously detected, the 
QoS measurement becomes unusable. In order to make 
QoS measurement reliable in the conventional QoS measuring 
25 system, it is necessary to perform matching to all combinations 
of possible ingrc333 and cgrc333 of the network. This is 
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practically impossible. 

Further, according to the conventional QoS measuring 
system, if the first inflow cell information of the inbound 
qiiAiiA match**? on* of trhft first N pip.op.s of outflow op. 11 
5 information in the outbound queue, then the pieces of outflow 
ceil information betore the matching one are discarded trom the 

outbound queue. If the first outflow cell information of the 

outbound queue matches one of the first N pieces of inflow cell 
information in the inbound queue, then the pieces of inflow cell 
10 information befuxe the matching one axe discarded fxoiu the 
inbound queue. Thereafter, a matching pair is expected to be 



*'U found at the first cell information in both inbound and outbound 

H queues. 

p However, as described before, since each IP packet La 

l& 15 forwarded to its destination bv each transit router determining 

;r{ the next hop depending on the IP addresses, the route to the 

^0 destination may change for each I? packet, resulting in delay 

0 

In4 variations at thp. egress S of the network. Thi* nansp.s the 

outflow cell information of the outbound queue to be out o£ 
20 sequence, in such situation, it the pieces ot cell mtormation 
before the matching one are discarded from the inbound or 
outbound queue, there are possibilities where the discarded cell 
information includes a matching one with the other cell 
information. Accordingly, the conventional QoS measuring 
25 system cannot provide reliahlp. QoS maasnrftrnftnts . 
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SUMMARY OF TH£ INVENTION 

An object of the present invention is to provide a 
QoS measuring system and method which can measure quality of 
service in a real-world network environment. 
5 Another object of the present invention is to provide a 

OoS measuring system and method which can measure quality of 
service provided to each of a plurality o£ connections included 
in a stream of packets. 

Still another object of the present invention is to provide 
10 a QoS measuring system and method which can identify a bottleneck 
fn causing reduction in QoS in a network. 

According to the present invention, a method for measuring 
quality of service (QoS) provided by a network, over which a 



O 

lU block of data having at least source and destination addresses 



::;s§5 



15 included therein is liciuaf eix.ed, includes the steps uf: a) 
determining an ingress and an egress of the network based on 
the source and destination addresses of the block of data; b) 
extracting feature information from the block of data at the 
ingrccs and the cgrccc, wherein the feature information 

20 identifies the block of data; c) determlninq whether first 
feature information extracted at the ingress matches second 
Icdluxe iiiluj-UidLioii eALiauLed al the eyiess; and d) when the 
first fp.^tnrp. information m^tchps thp KP.r.nnrl fp.atnrp 
information, measuring Qo3 based on a matching pair of the first 
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feature information and the second feature information. 

The method may further include the steps of: at the ingreee , 
determining the egress to which the block of data is forwarded 
from the ingress, based on the source and destination addresses 
5 of the block of data; and sending the first feature information 
to the egress, wherein, at the egress, the steps c) and d) are- 
performed. 

The step b) may include the steps of: stamping the block 
of data with a first time ctamp at the ingreee ; and etamping 

10 the block of data with a second time stamp at the egress , wherein , 
in the step d) , QoS is measured based on the first and second 
tim© stamps of tha matching pair. 

The. method may further include the steps of: registering 
the feature information extracted from the block of data and 

15 its registration time into a buffer; when a matching pair is 
found in the step c) , deleting feature information corresponding 
to the matching pair from the buffer; and when feature 
information is left in the buffer after a predetermined lifetime 
expires, processing a block of data identified by the feature 

20 information as being lost. 

The method may further include the step of: determining 
whether the block of data is targeted for QoS measurement at 

the ingress and the egress , wherein, only when the block of data 
is taxyeted for QoS measuiejuent , the step b) is pexf united. 
25 As described above, when a block of data enters a network 

at a node, its destination node in the network is determined 
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based on its source and final destination addresses. Such a 
destination can be determined by referring to a preset network 
configuration data or also using MPLS (multiprotocol label 
switching). Th* fwtnrft data identifying the inflow block of 
5 data is forwarded to the egress at the destination node. 
Accordingly, at tne egress, it can oe determined whether an 
outflow block of data captured at the egress is identical to 
the inflow block of data by comparinq feature data of the outflow 
block of data with that of the inflow block of data. When 
p 10 I hey match, QuS iufuiuiaLiuu fui Llidt bluck of dala piGvided by 

ftl the network can be computed by detecting , for example, a 

difference between inflow time stamp and outflow time stamp 
thereof. On the other hand, when no match is tound, it can be 
determined that Iocs of data or come exception event occurs in 
15 the network. 

Preferably, data screening is performed before such 
feature data comparison, causing efficient and high-speed 
QoS measuring. 

According to anther aspect of the present invention , 
20 a measuring probe is installed at each via point on a route 
forwarding a block of data. Such arrangement causes 
QoS measuring for each sub-network or link, allowing the 
location of a bottleneck to be detected and identified. 
The method further includes the steps of: at each of the at least 
25 one via-point node , h ) extracting third feature data from a third 
block of data passing through the via point node, wherein the 
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third feature data Identifies the third block of data; 1) 
determining an egress where the third block of data is to flow 
Irom the network, based on source and destination addxesses of 
thA third block of data; and j) sending thp third fpature data 
5 to the egress. In this case, the method may further include the 
steps ot : at tne egress, JO receiving the third teature data 
from each of the at least one via-point node; 1) when it is 
determined that the second block of data is identical to the 
first block of data, comparing the third feature data with the 
y_ 10 fixst featuits data tu de teimiiie whethex the thiid block of data 

iS is Identical to the first block of data; and m) when it is 

W determined that the third block of data for each of the at least 

Q 

*4 one via-point node is identical to the first block of data. 

Q computing QoS based on the first, second and third feature data- 

[ A 15 The method may includes the steps of; at a via-pomt node, 

lf % h) receiving the first feature data from the ingress; i) 

; y 

hO extracting third feature data Irom a third block of data passing 

w 

H through thA via -point nodA, vhArAin thA third feature data 

identifies the third block of data; j) comparing the third 

20 feature data with the first teature data to determine whether 
the third block of data ie identical to the first block of data; 
and k) when it is determined that the third block of data is 
identical to the first block of data, computing QoS based on 
the first and third feature data, 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Fly. 1 is a block diagram showing a QoS mt?asui.iny syslem 
according to a first embodiment of the present invention: 

Fig. 2 is a detailed block diagram showing a measuring 
5 probe for U3e in the first embodiment as shown in Fig. 1; 

Fig. 3 is a detailed block diagram showing an upper control 
data manager, an upper QoS manager, and a QoS displaying 
processor, which are included in the first embodiment as shown 
in Fig. 1; 

10 Fig. 4 i3 a flow chart showing an inflow packet processing 

operation performed in the measuring probe of the first 

embodiment ; 

Fig. 5 is a flow chart showing an outflow packet processing 
operation performed in the measuring probe of the first 
l:> embodiment; 

Fig. 6 is a diagram showing a format of captured packet 
discrimination data; 

Pig. 7 is a diagram showing a format of np.twnrk 
configuration data; 
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Fig. 8A is a diagram showing a format of data stored in 
a buff ex of the iiieasuiiny pxobe; 

Fig. OD is a diagram showing a format of feature data; 

Fig. 8C is a diagram showing feature items; 

5 Fig* 9 is a block diagram showing a QoS measuring system 

according to a second embodiment of the present Invention; 

Fig. 10 is a detailed block diagram showing a measuring 
probe for use in the second embodiment as shown in Fig. 9; 

Fiq. 11 is a block diagram showing a QoS measuring system 

ID according to a third embodiment of the present invention? 

Fig. 17 is a block, diagram showing a QoS measuring system 
according to a fourth embodiment of the present invention; 

Fig. 13 io a detailed block diagram showing a f irct example 
of an edge measuring probe for use in the fourth embodiment as 
15 shown in Fig. 12; 

Fig. 14 is a dAtai lftd block diagram showing a first example 
of a core measuring probe for use in the fourth embodiment a3 
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snown in Fig. 12; 



Fiy. 15 is a flow chart shvwliiy au yytsxation perfoimea 
in the first example of the core measuring probe as shown in 
Pig. 14; 



□ 



ru 
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5 Fig. 16 is a detailed block diagram showing a second 

example of the edge measuring probe for use in the fourth 
embodiment as shown in Fig* 12; 



Fig. 17 is a detailed block diagram shoving a second 
example of the core measuring probe for use in the fourth 
10 embodiment as shown in Fig. 12; and 



Fig, 18 is a flow chart showing an operation performed 
in the second example of the edge measuring probe as shown in 
Fiy. 16. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 



15 First Embodiment 

Referring to Fig. 1, it is assumed for simplicity that 
a iielwuiK 10 which is undei QuS measurement is composed of 
rontp.rs 11-14 nonnp.c.fp.d by links 111-115. A plurality of 
servers 21-23 are connected to the routers 11, 13, and 14 by 
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access links 121-123, respectively. The servers 21-23 are 
allowed to communicate with each other by transmitting and 
receiving data in packets through the network 10. 

Thft access links 121-123 arA providAd with packAt probes 
5 30.0 to 30.2 which are connected to measuring probes 31.0 to 
31,^, respectively. The respective packet probes io,u to 30.^ 
pickup packets on the access links 121-123. Hereafter, a packet 
on each access link flowlnq from a corresponding server to 
the network 10 is called an inflow packet and a packet on each 
10 access link Iluwiny £j.uiu Lhe iielwuik 10 to d corresponding Solver 
i.<5 called an nut€low packet. *s described later, each of 
the measuring probes 31.0 to 31*2 processes inflow packets and 
outtiow packets separately. 

The measuring probes 31,0 to 31.2 are connected to 
15 a monitoring network 7 0 to exchange feature data, which will 
be described later. The monitoring network 70 is preferably 
separated Irom the network 10 , The monitoring network 70 also 
connects the. measuring probes 31 .0 to 31.2 to an upper control 
data manager 40, an upper QoS manager 50 connected to a QoS 
20 displaying processor 60. and a time server 80 connected to a 
GPS antenna 81, In this embodiment, the measuring probes 31.0 
to 31.2 have the same structure, which will be described below 
with reference to Pig. 2. 
Measuri ng probe 

2s In Fig. 2, general reference numerals 310. 320. ...are used, 

which correspond respectively to reference numerals 310.0, 
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320.0, ... in tne measurinq proves 31.0 and reference numerals 
310.2, 320.2, ... in the measuring probes 31.2. The measuring 
pxube is provided with an inf low packel piocessor 310 , an oulf 1<jw 
packet processor 320. a QoS processor 3**o, * control processor 
5 340, and a captured packet discrimination data 314. 

The intlow packet processor 310 processes lntlow packets 
picked up by the packet probe 30. The inflow packet processor 

310 includes a packet capturing section 311, a time stamper 312, 

a packet discriminator 313, a feature extractor 315, a 
y, 10 destination discriminator 316, a network cunf iyuialiun data 317, 
and a feature data sender 318 . The feature data sender 318 sends 



[U feature data of an inflow packet to another measuring probe via 



vj the monitoring network 70, wherein the other measuring probe 

n io connected to an acccoa link to which the inflow packet ic 

t? car 

s\ 15 forwarded via tne network 10. 

The outflow packet processor 320 processes outflow packets 

i y 

picked up by Lhe packet probe 30. The outflow packet processor 

n 

j»4 320 includes a packet capturing section 371 , a tim* stamper 322, 

a packet discriminator 323, and a feature extractor 324. 

2U Tne captured packet discrimination data 314 stores data 

which ic uced by the packet diecriminatore 313 and 323 to 
determine whether a captured packet is a packet to be 
QoS-measured. The captured packet discrimination data 314 
defines predetermined conditions including authorized 

2S destination and source addresses and application classes 

(telnet, FTP, HTTP and so on) of a packet. An example of the 
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captured packet dis crimination data 314 is snown m rig, 6. h 

host address or network address may be used as source and 

destination addresses*. 

The network configuration data 317 stores data indicating 
5 the configuration of the network 10, which is used to determine 
the destination address of a measuring probe to which the feature 
data is forwarded via the monitoring network 70. An example of 
the network configuration data 317 is shown in Fig. 7. The 
destination address of the captured inflow packet is used to 
10 find the address of a destination measuring probe and a plurality 
of possible routes to the destination measuring probe. A host 
address or network address may be used as source and destination 
addresses . 

The QoS procc33or 330 procc33C3 information of a captured 
15 outflow packet and inflow information of that captured packet 
to produce a QoS measurement o£ the corresponding packet flow. 
The QoS processor 330 includes a featuie matching section 331, 
a feature data receiver 332. a QoS measuring section 333. and 
a QoS information sender 334. 
2i) The teature matching section 331 includes an outflow 

packet data buffer 335 and an inflow packet data buffer 336. 
The outflow packet data buffer 335 stores feature data with 
buffer registration time as shown in Fig. 8A. The inflow packet 
data bullet 336 sLoi.es leatuxe data inputted Zlvxu the fcaLuie 
data rAr.p.ivAr 332 with hnffpr rAgi <?tr«f i on HmA as shown in Fig. 
8A. The feature data receiver 332 receives feature data from 



2001 10/26 FRI 17:38 FAX 03 3288 3222 Ktsuragi Patent -» OSTROLENK 



iOb-565 15 

another measuring probe via the monitoring network 70. 

Feature data identifies an individual packet and indicates 
when the packet flowed into the netwuxk 10 oad which measuring 
probe captured it. An example of feature data is shown in Fig. 
5 OD . The feature data includes time stamp , identifying features , 
and probe ID code identifying the probe that has monitored the 
packet. The identifying features identifies an individual 
packet. An example of feature items is shown in Fig. 8C. 

The feature items are previously determined so as to detect 
10 that a packet egresslng from the network 10 at a location is 
the same packet that entered the network 10 at a separate 
location. Such feature items are considered to include header 
information. CRC (Cyclic Redundancy Check) information, a part 
of data, data 3izc, application class , destination address, and 
15 source address. Since the feature data travels over 

the monitoring network 70, it is desirable that the feature items 
axe effective at identify lay the yaiue packet da described above 
and the amount of features is as small as possible. In addition, 
a smaller amount of feature data makes the feature matching 
2U taster. 

In thic example ac chown in Fig. 8C, the feature items 
are composed of the contents of an IP header and a part of IP 
data. However, the lifetime of the IP header is removed from 
the Icdtuxe items because the lifetime is different 
hfttwp.«n network ingress and agrass. Thft part, of TP dat* is the 
first 256 bits of IT data. The part of IT data may be composed 
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of different parrs of IP data, for example, the top, midpoint, 
and bottom of IP data. It ie necessary to include the part of 
IP data as a feature item. If only the contents of IP header 
are used as the feature items, then different packets may be 
5 recognized as the same packet when a plurality of packets are 
addressed to the same destination. 

The QoS information sender 334 sends QoS information to 
the upper uos manager i>o via the monitoring network /u, 

The control prooeccor 340 managee the captured packet 
H 10 discrimination data 314 and the network conf iquration data 317 . 

The control processor 340 includes a control data manager 341 

fit 

^ and a control data sender /receiver 342. The control data 

^ s«nder/rftcp.i v*r 34?. connects to the upper rnntrol data manager 

O 40 to download the captured packet discrimination data and 

U 15 the network configuration data from the upper control 
?y data manager 40 , 

sit 

JSJ Management: sections 

The upper control data manager 40 manages master data of 
data stored in the measuring probes. The upper control 
20 data manager 40 includes a control data sender /receiver 41, 
a network configuration data manager 42 , a network configuration 
data master file 43, a captured packet discrimination 
data manager 44, and a captured packet discrimination 
data utaslei file 45. The captured packet discxiuiinaLiuii data 
?5 and the network configuration data are sent from thft captured 
packet discrimination data manager 44 and the network 
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configuration data master file 43 to the measuring probes to 
update the captured packet discrimination data 314 and 
the network configuration daLa 317 in each measuring probe. 
The upper QoS manager 50 collects QoS information from 
5 the measuring probes via the monitoring network 70 and manages 
them. The upper QoS manager 50 includes a QoS information 
receiver 51 , a QoS information manager 52 , and a QoS information 
storage 53. the collected OoS information is output to the OoS 
displaying processor 60. The QoS displaying processor 60 

10 provides a man-machine interface and includes an editor 61 for 
editing QoS information and a GUI display 62 for displaying 
edited QoS information. 

The inflow and outflow packet processors 310 and 320 are 
provided with time stampers 312 and 322. It i3 nccc33ary to 

15 accurately synchronize the time information held in these time 
stampers in the monitoring network 70. For this purpose, the 
Lime sexver 50 is provided as a Lime master in 
the monitoring network 70 . A time information protocol such as 
NTP (Network Time Protocol) is used to correct the time 

2U information of the time stampers 312 and 322. In the case of 
NTP, the time ocrvcr 80 ic preferably a stratum- 1 server having 
accurate time information, it is necessary to correct the time 
information of its own at all times by referring to high-accurate 
Lime iiif uriualiuu obtained by, lux example, GPS (Glubal 

75 Positioning Sysrp.m) . Tn this ftmhnrti mp.nt , thp. GPS antfinna 81 is 
connected to the time server 80 to accurately correct its own 
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time information. 
O peration 

An operation of the first embodiment will be described 
with reference to Figs. 4-8. 
5 1} InflgH packet prggg^ing 

Referring to Fig. 4, when an inflow packet is captured 
by the packet capturing section 311 (step SI) , the time stamper 
'4L2 stamps the inflow packet with the current time stamp (step 
S2). Thereafter, the packet discriminator 313 searches the 
10 captured packet discrimination data 314 to determine whether 
jjJ the inflow packet is a packet to be QoS-measured (steps S3 and 

O S4). Only when it is to be QoS-measured (YES at step S4), the 

tn parkftt- i«; output fo the feature extractor 315. By screening 

O 

captured packets to the captured packet discrimination data 314 , 
15 the number of packets to be subjected to the feature matching 
»y can be reduced, resulting in enhanced speed and efficiency of 

Lhe fed Lure matching. 

The feature extractor 315 extracts features as shown in 
Fig. OC from the inflow packet passing the packet discriminator 
20 313 (step S5J. The extracted features are output to the 

destination discriminator 316, The destination discriminator 
316 uses the destination information of this inflow packet to 
search the network configuration data 317 for a destination 

pi.ube address (DPA) which lb Lhe address uf a 
7^ dp.sfinati on measuring probp to wMrh thp. fpatnrp Hata should 
be sent (step 36) . When DFA (here, the address of the measuring 
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probe 31.2) is found (yes at step 57) , the feature aata as snown 
in Fig. 8B is created from the extracted features identifying 
the inflow yauhel (step S3) and then is sent lo the 
destination measuring probe (here, the measuring probe 31.2) 
5 via the monitoring network 70 (step S9). When no DPA is found 
{NO at step S7), an error notification is created (step S10) 
and then is sent to the upper QoS manager 50 via 
the monitoring network 70 (step Sll). 

The inflow packet to be forwarded from the server 21 to 

10 the server 23 enters the i outer 11, travels over the network 
10 to the router 14, and arrives at the server 23 through the 
access link 123* When the packet flows through the access link 
123, the monitoring probe 30.2 detects the packet as an outflow 
packet and 3cnda it to the measuring probe 31.2. The outflow 

15 packet processing operation wiii be described witn reference 
to Pig. 5 and Fig. 2. 
2) Ou LIlow pdckel p r.Q&B.s.siiiq 

Referring to Fig. when outflow packet is captnrp.d 
by the packet capturing section 321 (step G12) , the time stamper 

20 322 stamps the outtiow packet with the current time stamp (step 
S13). Thereafter, the packet discriminator 323 eearchec the 
captured packet discrimination data 314 to determine whether 
the outflow packet is a packet to be QoS -measured (steps S14 
and S15) . Only when it is to be QoS-measured (YES at step 313) , 

2.S fchA packp.t i s output to thft feature ftxtrartor 324 . The screening 
of captured packets is similar to the packet discriminator 313 
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as described before. The captured pacKet discrimination data 

314 is used by both the packet discriminators 313 and 323 to 
apply the common packet discrimination condition to inflow and 
outflow packets. As described before, the captured packet 
5 discrimination data 314 is harmonized between the measuring 
probes over the system, which is achieved by. for example, 
downloading it from the captured packet discrimination 
data master file 45 of the upper control data manager 40. 

The feature extractor 324 extracts features as shown in 
10 Fig. ac from the outflow packet passing the packet discriminator 
323 (step S16). The extracted features and the current time 
stamp are output as feature data as shown in Fig. 8B to the 
feature matching section 331 of the QoS processor 330. The 
feature data of the outflow packet i3 stored in the outflow 
15 packet data buffer 336 together with its registration time as 
shown in Fig. 8A (steps S17 and S18). 

On the other hand, ay described before, the feature data 
receiver 332 receives feature data from other measuring probes 
at inflow locations via the monitoring network 70 (step 319). 
2U Here, the feature data receiver 332 ot the measuring probe 31.2 
receives the feature data of the corresponding inflow packet 
from the measuring probe 31.0. The feature data of the 
corresponding inflow packet is stored in the inflow packet data 
UuXTcj. 335 (steps S20 auQ S21). 

Thp f p.arnrp. matching spr.tion 331 compares the feature data 
stored in the inflow packet data buffer 335 with the feature 
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data stored in the outflow packet data Duffer 336 to detect 

a matching pair of inflow and outflow packet feature data (steps 
S22 and S23) . When a malchiuy paii JLt? found, the matching pair 
of inflow and outflow packet feature data is output to the 
5 QoS measuring section 333 and then is deleted from the inflow 
packet data buffer 335 and the outflow packet data buffer 336. 
However, feature data having no match is not deleted. 

As described before . in an actual network such as Internet , 
there are cases where some outflow packets are out of sequence, 
U 10 lost, or duplicated due to random packet transmission by a 

h 

S plurality of other end parties, delay variations , loss of packet, 

retransmission ot packet, and the like. In order to perform the 
feature matching with reliability, the first data of each buffer 
is sequentially compared to all data of the other buffer to find 
15 a matching pair. 

However, such one -to -all feature matching method may be 
tiuie-coiiauiiiiuy • Preferably, the inflow packet data buffer 335 
and the outflow packet data buffer 336 is searched to select 
feature data to be matched with using the time stamp of feature 
2i) data as a key. Then, a narrower set of selected feature data 
ic subjected to the feature matching, resulting in reduced time 
required for matching. For example, a correspondence table 
between network address (host address) and a mean delay time 
Is previously prepaied. When the feature matching Starts., 
a nnmbp.r of fp.atnrp. riaf* having Hmp. stamps in th* vicinity of 
a corresponding mean delay time are selected from one buffer 



fU 
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ana is subiectea to the feature matenmq. if no matching pair 
is found, a number of feature data having time stamps falling 
Xulv a lanye of the coiiespoudiiiu. mean delay Lime plus 
or minus n msec are selected from one buffer and is subjected 

5 to the feature matching. If no matching pair is found in this 
condition, a number of feature data having time stamps tailing 
into a range of the corresponding mean delay time plus or minus 
2n msec are selected from one buffer and is subjected to the 
feature matching. 

10 la LIjIjs uicuiuer, a uaxxuwer sel of fealuxe dala xesulls 

in reduced time required for matching . The correspondence table 
between network address (host address) and a mean delay time 
is preferably updated automatically by actually measured delay 
time, This makes the feature data selection more accurate, 

15 resulting in further reduced time required for matcmnq. 

When a matching pair is found, the matching pair is deleted 



from the inflow packet data buffer 335 and the outflow packet 



* dat* buffer 316- Hnwwe.r, feature data having no match is not 

deleted but left in the inflow packet data buffer 335 and the 

20 outtlow pacKet data outrer 330. to avoid increasing reature 
data without limitation, an in-buff er lifetime ic previously 
determined. Since the buffer registration time stamp is 
attached with the feature data as shown in Fig. 8A, the feature 
data alter the in-bulfer lifetime expires can be deleted. In 
25 this way. the number of feature data in each buffer can be reduced, 
which avoid3 increasing the time required for feature matching . 
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in Fig. 5, when no matchlnq pair is found (NO at step S23) , 
the buffer registration time is checked (step S28). Whan the 
feature data stays in the inriuw packet data buffer 335 after 
thft 1n-hnff*r TifAfiniA Avpi r«s (YES at RfAp *nd YRS at Step 
5 S30), o packet loss event notification is created (step 331) 
ana the teature data is deleted trom trie intiow packet data 

buffer 335 (step £33)- The packet Iocs event notification is 
sent as Qos information to the upper qos manager 50 (step S34) . 
When the feature data stays in the outflow packet data buffer 
10 336 aftex the in-buffex lifetime expixes (YES at step 529 and 
NO at step S30) . an exception event notification is created (step 



□ S32) and is sent as QoS information to the upper QoS manager 

H 

in 50 (step S34) after the feature data is deleted trom the outflow 



packet data buffer 336 (step S33). When receiving QoS 

15 information at the Qos information receiver 51 or the upper 
QoS manager 50, the QoS information manager 52 arranges and 
stores them in the QoS information storage 53- 

Tn thft msa nf ?i nodA with a large amount of traffic, T.hftr* 
are cases where the above -described measure is not adequate. 

20 Accordingly, there are prepared a plurality of intiow packet 
data buffers and a plurality of outflow packet data buffers. 
The feature data of an Inflow packet is stored into a selected 
one of the inflow packet data buffers depending on the 
source/destination address, the application class, or a 

25 combination thereof. Similarly, the feature data of an outflow 
packet .io stored into a oclcctcd one of the outflow packet data 
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buffers depending on the source/destination address , the 
appl "i rati on class, nr *\ rnmhin^Hnn thp.rpnf . Sncn arrangement 
can reduce the amount o£ feature date for each buffer* The 

teature matenmg is perrormeci by comparing the teature data of 
5 an inflow packet data buffer with that of a corresponding outflow 
packet data buffer. Therefore, the amount of feature data to 
be compared becomes smaller , resulting in faster and more 
reliable matching opera Lion. Such divided buffer selection is 
p.nabled by using packet discrimination processing of the packet 
10 discriminator. 

A typical communication protocol in the Internet is TCP/IP 

a 

(Transmission Control Protocol/Internet Protocol) and UDP/IP 
(user Dataqram Protocol/internet Protocol). TCP/IP provides 
connection-oriented communication and, when a communication 
13 failure such as loss of packet occurs, can detect the failure 
and performs restoration snr.h as rprransmi ssi nn of packp.t . 
Contrarily, UDr/IF provides connectionless communication and, 

even if a communication failure occurs, cannot detect the 
failure and therefore restoration is not performed. In other 
20 words, compared to TCP/IP, UDP/IP provides relatively low 
reliability but relatively high transmission efficiency in 
communication. Accordingly, HTTP uses TCP/IP, while FTP uses 
UDP/IP. 

Consider the case where a loss event occurs on the network. 
25 UDP/IP can detect a packet at the ingress of the network but 

at the egress thereof. However, TCP/IP detects only one packet 



m 



•5^ 
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at the eqress and detects a plurality of packets at the ingress 
because o£ retransmission o£ a lost packet. Accordingly, 
depending on how to select feature items, these packets may have 
th* sam* fftaturA data. 
5 in such case, the feature matching may be performed by 

sequentially comparing teature data stored m tne outrlow and 
inflow buffers in the direction from top to bottom to detect 
a matchlnq pair and, once the matchlnq pair is found, the 
feature matching is terminated. However, the found matching 

10 paix is uuL an oiiyinal pait of Ihe uullluw packet dad d 

corresponding inflow packet but a pair of the outflow packet 
and a first sent inflow packet that has been lost in the network, 
because the teature data ot such first sent inflow packet was 
already received at the feature data receiver 332 from the 

15 corresponding measuring probe as described before. The QoS 
information can be computed from the feature data of the outflow 
packet and the first sent inflow packet. Such QoS 
Information may be acceptable hecanse the failure actually 
occurs in the network. 

20 in the case where accurate UoS information reflecting the 

actual statue of the network is needed, the following method 
is effective. When a matching pair is found, the v 
feature matching continues until further up to N pieces of 
feature data in the inflow packet data buffer 335 has 

25 been matched with the feature data of the outflow packet. If 
a plurality of matching pairo hao been found, the latcot matching 
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pair is used to compute QoS information ana tne otner matcmng 
pairs ara handled as loss ©vents. In this manner, a 
proper matching pair ami loss eveuls can be delected. However, 
from a viewpoint of processing speed, this 
5 feature matching method is preferably applied only to the 
connection-oriented communication such as TCP/IP, not to the 
connectionless communication . 

in Fig. 5, when the feature matching section 331 detects 

a matching pair (YES at step S23), the QoS measuring section 
10 333 delects a transmission delay lime from a difference between 
the time stamps of the matching pair to compute QoS information 
(step S24). Thereafter, the QoS information sender 334 sends 
M the QoS information to the upper QoS manager 50 via 

5 

O the monitoring network 70 (step S25, S27) . At the some time, 

15 the feature data of the matching pair is deleted from tne inflow 
and outflow packet data buffers 335 and 336 (step S26) . The QoS 
COiiipuldLiou in the slep S24 may be performed in the upper 
QoS manager 50. The above- described steps S27-S3* are 
repeatedly performed until the buffers ore empty (step S35)- 
2u wnen receiving gos mtormation at tne QoS mtormation 

receiver 51 of the upper QoS manager 50, the QoS 
information manager 5 2 arranqes and stores them in the QoS 
information storage 53 . The QoS displaying processor 60 inputs 
QoS informalion from the uppcx QoS manager 50 and edits or 
7.5 prncASSAS it. according to a user's instruction. Thft raw or 
edited QoS information is presented to users through the GUI 



j.6 

a 
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display 62. 

A predetermined threshold if QoS information may be 
provided in the QoS information manager 52. II QoS inloiiuaLiua 
receivad from the measuring probe deteriorates below thft 
5 threshold, then the QoG displaying processor 60 automatically 
alerts the system user to a reduction in t?os . such threshold may 
be provided for each ingrecs/egresc of packets, each 
source/destination of the packet, each application class, or 
a combination thereof, 

10 In Lhe first embodiment, it is impuitant tu make the 

raptured par.Vp.t di scH m-i nat i on data 314 and the network 
configuration data 317 consistent over the system. Such 
consistency is ensured by communicating with the upper control 
data manager 40. For example, the captured packet 

15 discrimination data 314 and the network configuration data 317 
are downloaded from the captured packet discrimination 
data master file 4 5 and the network configuration data master 
file 43. when a corresponding master file 1s updated, when 
a measuring probe start 3 up, or at regular intervals. 

20 Second Kmbodiment 

A QoS measuring system according to a second embodiment 
of the present invention is designed to measure QoS in the case 
of traffic aggregation with a single access link. 

In Fig. 9, blocks and elements similar to those previously 

25 described with reference to Figs. 1-3 are denoted by the same 
reference numerals and the details will be omitted. In the 
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second embodiment, il is assumed for simplicity that u servers 
Al-An and a gateway A are installed in a business place A , n 
servers Bl-Bn and a gateway B are installed in a business place 
B. and n servers CI -Cn and a gateway C are installed in a business 
5 place C. The servers Al-An are connected to the gateway A, which 
is connected to the network 10, Similarly, the servers Bl-Bn 
are connected to the network 10 through the gateway B and the 
servers Cl-Cn are connected to the network 10 through the gateway 
C. 

10 For example, consider that the servers Al-An of the 

business place A r.nmmuni cat e with the servers Bl -Fin of the 
business place B through the network 10- The gateway A receives 
sending packets trom tne servers At -An and aggregates them into 
an aggregate flow of packets, which ie sent to the network 10. 

15 When receiving an aggregate flow of packets from the network 
10, the gateway A delivers receiving packets among the servers 
Al-An depending on their destination addresses. Similarly, the 
gateway B receives sending packets from the servers Bl-Bn and 
aggregates them into an aggregate flow of packets, which io acnt 

20 to the network 10. When receiving an aggregate flow of packets 
from the network 10, the gateway B delivers receiving packets 
diuoiiy Lhe servers Bl-Bn depending on Lheir des Linaliun 
addresses . 

In this case, each of the measuring probes 31.0 and 
25 31.2 measures QoS tor each packet flow in an aggregate tlow or 
inflow/outflow packets in n-to-n communication. The measuring 
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prooes 31.0 to 31.2 accorainq to tne second embodiment nave tne 
sama structure as shown in Pig. 10. 

In Fig. 10. blocks and elements si mi 1*r to thns* previously 
5 described with reference to Fig. 2 are denoted by the same 
reference numerals and the details thereot will be omitted. 

Referring to Fig. 10, the measuring probe is provided with 
an inflow packet processor 310 , an outflow packet processor 320 , 
a QoS processor 330, a control processor 340, and a captured 
10 packet discixmiuciLiua data 314. 

The inflow packet processor 310 processes inflow packets 
picked up by the packet probe 30. The inflow packet processor 
310 includes a packet capturing section 311. a time stamper 312 . 
a packet discriminator 313, a feature extractor 315, a 
15 destination discriminator 316 , a networK configuration data 317 , 
and a feature data sender 318 . The feature data sender 318 sends 
feature da La of an inflow packet to another measuring probe via 
thp monitoring network 70 , wherein thp. othp.r mAJisuH ng prohPt 
is installed at an egress location to which the inflow packet 
20 is torwaraea via tne network io. 

The outflow packet processor 320 processes outflow packets 
picked up by the packet probe 30. The outflow packet processor 
320 includes a packet capturing section 321, a time stamper 322, 
a packet discriminator 323, and a Teature extractor 324. 
25 The captured packet, discrimination data 314 stores data 

which ±3 u3cd by the packet discriminators 313 and 323 to 
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determine whether a caprured packer is a packer ro Pe 
QoS-measured. The network configuration data 317 stores data 
indiualiny the uunfiyujLciliua uf the network 10, which is used 
to dp.tATmine the destination addrpss of * measuring probe to 
5 which the feature data is forwarded via the monitoring network 
70. 

The QoS processor 330 processes information of a captured 
outflow packer and inflow informarion of rhar caprured packer 
to produce a QoS measurement of the corresponding packet flow. 
10 The QoS pxuuebbux 330 includes a featuie malchiny secliun 331, 
a feature data receiver 332. a QoS measuring section 333. a 
buffer storage controller, and a QoS Information sender 334. 

The buffer storage controller includes a plurality of 
inflow packet data buffers 335 and a plurality of outflow packet 
15 aara purrers 336. The Puffer sroraqe conrrolier seiecrs one 



ru 



Cm 
•3 



y inflow/outflow buffer to store feature data of an inflow/ outflow 

ft s 

Hp packet depending on destination and source addresses, 

t-sl 

fl application olass and rhft like of thft inflow/outflow paolcAt. 

The feature data receiver 332 receives feature data from 

20 anorher measuring probe via rne monitoring network vu and rhe 
received feature data is stored in a selected one of the inflow 
packet data buffers 335. The feature matching section 331 
searches a selected pair of inflow packet data buffer and outflow 
packet data buffer Tor a matching pair as in the first embodiment 

25 as described before. The QoS measuring section 333 measures QoS 
from feature data of the found matching pair. The QoS 
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information sender 334 sends Qos information to tne upper 

QoS manager 50 via the monitoring network 70. 

According to such axraugewenl, Lhe measuring pi.ube can 
identify the egress location of the network 10 for a captured 
5 inflow packet in an aggregate flow of inflow packets and sends 
feature data of the inflow packet to the measuring probe located 
at the identified egress. In addition, the measuring probe can 
identify the ingress location of the network 10 for a captured 
outflow packet in an aggregate flow of outflow packets and can 
10 search for a matching pair to measure QoS for the packel flow 
in question in the network 10. Accordingly, it is possible to 
efficiently measure QoS for a session between certain nodes even 
in the case of packet aggregation, without installing 
individual measuring probca at all ingrcaa/cgrcoa nodes of 

15 the network 10. 

Further, the feature data of inflow/outflow packets are 
diiiLxibuLed cmiuiiy Ihe plurality of inflow/outflow packet data 
buffers depending on destination and southa adrirp.s.qp.s , 
application class and the like of an inflow/outflow packet. The 

2U amount ot feature data for each Dutter can oe reduced ana tne 
feature matching is performed by comparing the feature data of 
an Inflow packet data buffer with that of a corresponding outflow 
packet data buffer. Therefore, the amount of feature data to 
be compaied becomes smaller, resulting in faster and more 

2.S reliabl* matching operation. Kven In the case of aggregate 
packet flow, high-speed and efficient QoS measuring can be 
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Third Embodiment 
A QoS measuring system auwidluy La a third embodiment 
of the. present invent"* on is designed to mpasnrp QnS in the 
5 environment where a server interconnects to another server via 
the network under QoS measurement and another network that is not 
under QoS measurement* 

in Fig. 11 , blocks and elements similar to those previously 
described with reference to Fig, 9 are denoted by the came 
10 leference numerals aud the details will be omitted, 
y Referring to Fig. 11, it is assumed for simplicity that n 

servers Al-An and a gateway A are installed in a business place 
M A and n servers Bl-Bn and a gateway B are installed in a business 

p place B . The ocrYcrs Al An arc connected to the gateway A, which 

L 15 is connected to the network 10 that is under QoS measurement 
W as described before. The servers Bl-Bn are connected to 

ru 

a network 11 through the gateway B. The network 11 is provided 



Til 

3 



by an P.xtp.rnal carrier and r.annnt bp provided with measuring 
probes. Therefore, the network 11 is not under measurement . 

20 xne network 11 is connected to the network iu by a link. 
Such network configuration having a plurality of networks 
interconnected is considered in the case where a private network 
is connected to the external Internet by a network of an ISP 
(Internet Service Provider) or ISP's networks interconnect to 

25 each other. 

For example, consider that the servers Al An of the 
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business place a communicate with the servers Bl-bn ot the 
business place B through the network 10 under QoS measurement 
and the network 11 not under QoS measurement. The gateway A 
receives sending packets from the servers Al-An and aggregates 
5 them into an aggregate How of packets, which is sent to 

the network 10. When rp.cftiving an aggregate flow of packets from 
the network 10, the gateway A delivers receiving packets among 
the servers Al-An depending on their destination addresses. An 
aggregate flow of packets ic transferred on the link oonnecting 
10 the network 10 and the network 11 and is monitored by 
the measuring probe 31.2. 

In such a network configuration, the network configuration 

information or routing information is used to identify th« 

ingress/egress node of the network 10 through which packets are 
15 passed to the external network 11. it is necessary to install 

a measuring probe (here, 31.2) at the ingress/egress location 

Lhiough which packets are passed to the external network 11. 

Accordingly, the measuring probe 31.0 can send feature data of 

an inflow packet to the measuring probe 31.2, which allows 
20 QoS measuring based on a matching pair of the received feature 

data and the feature data of an outflow packet to the 

external network 11. 

The ingress/egress node of the network 10 through which 

packets axe passed tu the external uetwuxk 11 can be identified 
35 prp.vion.^ly, for pv^mple , when vising a rontp nVtprmi n*t i on mP.ans 

such as MPLG {multiprotocol label switching), previously 
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determining a node that is an interconnection point to the 
external network IX, or fixing a route in the network 10. 
Further, it is possible to compute a route using routing 
information exchanged between routers, such as RIP (Routing 
5 Information Protocol) or OSPF (Open Shortest Path First). 

The network configuration data 317 may he provided with 
transfer route information to the ingress /egress node of 
the network 10. for example, in the form as shown in rig. 7. 
In the caee ac chown in Fig. 11, the measuring probe 31.2 ic 

10 installed in the router interconnecting to the external network 
11. Accordingly, when capturing an Inflow packet addressed to 
the business place B, the measuring probe 31.0 can send feature 
data of the inflow packet to the measuring probe 31.2 by 
referring to the network configuration data 317. 

15 The structure of a measuring probe according to the third 

embodiment is substantially similar to that of the measuring 
probe da shown in Fly. 10. As describe above, the network 
configuration data 317 further stores the transfer route 
information to the ingress /egress node of the network 10. 

2U Accordingly, the destination discriminator 316 can identify the 
addrcas o£ a measuring probe located at the interconnection 
point to the external network li depending on the destination 
and source addresses, application class, and the like of the 
uapluj.e<2 inlluw packet.. 

?A Tn this manner, traffic: aggregation QoS measuring is 

allowed in the environment of a plurality of networks including 
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ones under QoS measnremenh and others not: under QoS mMsiirmnent . 

Fourth Embodiment 
A uoS measuring system according to a fourth emooaiment 
o£ the present invention ie designed to measure QoS in the 
5 environment where a server connected to the network under 
QoS measurement interconnects to another server connected to 
the network under QoS measurement via at least one 
ftvtArnal network that i s nnt nndftr QnS mAnsnrpnipnt . According 
to the third embodiment, edge measuring probes and 

10 core measuring prooes are proviaea as aescrioea oeiow, to allow 
QoS measuring at transit point and thereby a bottleneck of the 
entire network can be identified when QoS deteriorates. 

In Fig. 12, blocks and elements similar to those previously 
described with reference to Fig, 11 are denoted by the same 

15 reference numerals and the details will he omitted. 

Referring to Fig. 12, it is a33umcd for simplicity that n 
servers Al-An and a gateway A are installed in a business place 
A and n servers Bl-Bn and a gateway B are installed in a business 
place B* The servers Al-An care connected Lo the yateway A, which 

20 is connected to a network 10_1 that is under QoS measurement 
as described before. The servers Bl-Bn are connected to the 
gateway B, which is connected to a network 10_2 that is under 
QoS measurement ao described before. The network 11 
Interconnects to the networks 10 l and 10 2. such network 

25 configuration having a plurality of networks interconnected is 
considered in the case where a piivate network is connected to 
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the external Internet 11 by a network of an TSP (Internet Service 
Provider) or ISP's networks interconnect to each other. 

In this embodiment, an edge measuring probe 31a is 
installed at an interconnection point (network edge, in many 
5 cases, access link) of the network io_i and the gateway A, a 
core measuring probe 31b at an interconnection point of 
the network 10_1 to the uetwoxk 11, a cure meaauxiuy piube 31c 
at an interconnection point of the network 10_2 to the network 
11, and an edge measuring probe 3 Id is installed at an 

10 interconnection point of the network 10_2 and the gateway B. 

For example, consider that the ocrvcr3 Al An of the 
business place A communicate with the servers Bl-Bn of the 
business placa B through the network 10_JL under QoS measurement , 
the netwuxk 11 uut under QoS measurement , and the network 10_2 

15 nn^p.r QoS measurement- The gateway * rp.cftive.q sending packets 
from the servers Al-An and aggregates them into an aggregate 
tlow ot packets, which is sent to the network iu_i, when 
receiving an aggregate flow of paoketc from the network 10_1, 
the gateway A delivers receiving packets among the servers Al-An 

20 depending on their destination addresses. An aggregate flow of 
packets is transferred between the network 10_1 and the network 
11. An aggregate flow of packets is transferred between 
the network 11 and the network 10_2, The gateway B receives 
sending packets rrom tne servers tfi-tm and aggregates them into 

25 an aggregate flow of packets, which is sent to th© network 10_2. 
When leceiviuy an ayyxeyate flow of packets fium the network 
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the gateway R del ivers receiving pankets among the servers 
Dl-Bn depending on their destination addresses. 

in such a network configuration, me edge measuring probes 
31a and 3 Id measure a packet inflow time and a packet outflow 
5 time. The core measuring probes 3lb and 31c measure a packet 
passing time. These measurement times (a packet inflow time at 
the edye measuring probe 31a, a passiay Lime al each 
core measuring probe 31b, 31c. and a packet outflow time at the 
edge measuring probe Did) are compared to compute the entire 
HJ QoS trom the business place A to B, and QoS provided by 
O each network, Further, QoS of a link of each network can be 

fy also measured, 

star 

\i The ingrees/egrecs node of the network 10_1, 10_2 through 

^ Which packet* die passed Lo the exLerual uelwuxk 11 Can be 

identified previously, for evampl e, when using a route 
determination means such as MFLS (multiprotocol label 
switching) , previously determining a node that is an 
interconnection point to the external network 11, or fixing a 
route in the network 10, Further, it is possible to compute a 
20 route using routing information exchanged between routers, such 
as RIP (Routing Information Protocol) or OSPF (Open Shortest 
Path First) . 

The network configuration data may be provided with 
transfer route information to the ingress/egress node of 

25 the network 10 1, 10.2, for example, in the form as shown in 
Fly. 7. In Uie case <as shuwu in Fly. 12, the measuxiny pj-ube 



ru 
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.lib, 31c "is installed at thp. noHp i nterconnp.cti ng to the 
external network 11. Accordingly, when capturing an inflow 
packet addressed to trie business place b, tne measuring probe 
31a can send feature data of the inflow packet to the measuring 
5 probe 31b and also the measuring probe 31c, 31d by referring 
to the network configuration data 317. In this manner, QoS 
information at an edge node or at midpoint (at a transit node 
within a network) can be obtained. 

There are two examples of a measuring probe depending on 
10 where time information (a packet intiow time at an edge measuring 
probe, a passing time at each core measuring probe, and a packet 
outflow time at an eaqe measurinq probe) are compared, 
Hereafter , the two examples will be described in details. 
Example I 

IS According to thp first pyamplp of the fourth p.mboHi mp.nt , 



U a core measuring probe perforins time comparison to compute 



ru 

hj individual delay times . The edge and core measuring probes will 

O 

be described with reference to Fige. 13 and 14, respectively. 

1) Edge measuring probe 
20 Referring to Pig. 13, an edge measuring probe 600 is 

provided with an inflow packet processor 610, an outflow packet 
processor 620. a QoS processor 630. a control processor 640, 
and a captured packet discrimination data 614. 

The inflow packet processor 610 processes inflow packets 

25 picked up by a corresponding packet probe installed at a node 
connected to <i business place network. The inflow packet 
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X>mcp.ssor 61fi innlndp.s a pankp.t. rapturing section 611, a time 
stamper 612, a packet discriminator 613, a feature extractor 

61$. a destination discriminator bib. a networjc connguration 
data 617, and a feature data cender 618. The destination 
5 discriminator 616 searches the network configuration data 617 
for egress and transit probe addresses. The feature data sender 
618 sends feature data of the inflow packet to the other 
p.dgp. mp.asnring prohp. (p.gress) corp. mpasnri ng prohp. (transit) 
via the monitoring network 70. 
10 Tne outflow packet processor b^u processes outflow packets 

picked up by the corresponding packet probe. The outflow packet 

processor 620 includes a packet capturinq section 621, a time 
stamper 622 , a packet discriminator 623 , and a feature extractor 
624. 

IS Thft captnrftd packet discrimination data 614 storp.s data 

which is used by the packet discriminators 613 and 623 to 

determine whether a captured packet is a packet to be 
QoS-meaeured. The network configuration data 617 stores data 
indicating the configuration of the network 10, which is used 
20 to determine the destination address of a measuring probe to 
which the feature data is forwarded via the monitoring network 
70. 

The QoS processor 630 processes information of a captured 
outflow packet and inflow information of that captured packet 
25 to produce a QoS measurement of the corresponding packet flow. 
The QuS processor 630 includes <i feature matching section 631, 
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a fe«tnrp data rp.r.ftivfir 6.32 , a QoS mp.asnring section 633, and 
a QoG information sender 634. The feature matching section 631 
an mtlow packet data outter e>3!> ana an outtlow packet data 
buffer 636 . The feature data receiver 632 receives feature data 
5 from the other edqe measuring probe via the monitoring network 
70 and the received feature data is stored in the inflow packet 
data buffer 635. The feature matching section 631 searches the 
•inflow packet data buffer and outflow packet data buffer for 
a matching pair as in the first embodiment as described before. 
IU The Qos measuring section 633 measures Qos trom teature data 
of the found matching pair . The QoS information sender 634 cends 
Qos information to the upper Qos manager 50 via 
the monitoring network 70 . 
2) Core measuring probe 

IS Referring to Fig. 14, a corp. measuri ng prohfi 700 annordi ng 

to the fourth embodiment is provided with a network transfer 

packet processor via. a network transfer packet processor /2u. 
a QoS proceeeor 730, a control proceeeor 740, and a captured 
packet discrimination data 714. 

20 The network transfer packet proceeeor 710 processes 

transit packets in the direction from the network 10_1 to 
the network 10_2. The network transfer packet processor 710 
includes a packet capturing section 711, a time 3tompcr 712, 
a packet discriminator 713, and a feature extractor 715. 

25 The network transfer packet processor 720 processes 

transit packets in the dixeutiun fj-um the netwuik 10_2 to 
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the network 10_1. The network transfer packet processor 720 
includes a packet capturing section 721, a time stamper 722, 
a packet discriminator 723, and a feature extractor 724. 

The QoS processor 730 includes a feature matching section 
3 731, a feature data receiver 732, a QoS measuring section 733, 
and a QoS information sender 734. The feature matching section 
731 includes an inflow packet data buffer 735, a right-transfer 
packet data buffer 736, and a left -transfer packet data buffer 
737 . Hereinafter, the term "right- transfer" means that a packet 
10 is transferred in the direction from the networK iu_i to 

the network 10_2 and the term "left-transfer* meanc that a packet 
is transferred in the direction from the network 10_2 to 

the network 10_1 . 

Accordingly, the network transfer packet processor 710 
15 captures a right -transfer packet and stores its feature data 
into the right transfer packet data buffer 736. The network 
transfer packet processor 720 captures a left-transfer packet 
and stores its feature data into the left- transfer packet data 
buff ex 737. The influw packet dala buffer 735, as described 
20 before, stores feature data received from edge measuring probes . 
The feature matching section 731 performs the 
feature matching by searching the inflow packet data butter 735, 
the right transfer packet data buffer 736 , and the left transfer 
packet data buffer 737 for a rlqht-transf er matching pair and 
25 a left- transfer matching pair, 

3) O peration of core measuring probe 
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An operation of the core measuring probe win be described 
with reference to Fig. 15. 

Referring to Fig. 15, a right -transfer packet is captured 
by the packet capturing section 711 and a left-transfer packet 
5 is captured by the packet capturing section 721 (steps S41, S42). 
Then, the tim* stamper 71 2 stamps the rf ght- transfer packet with 
the current time stamp and the time stamper 722 stamps the 
left-transfer packet witn tne current time stamp (steps S43, 

S44). Thereafter, the packet discriminator 713 ccarchco the 
10 ' captured packet discrimination data 714 to determine whetner 
the right-transfer packet is a packet to be QoS-measured (steps 
S45 and S47). The packel disci iminalur 723 searches Lhe 
captured parke.t di snriminati on data 714 tn rietprminp whether 
the left- transfer packet is a packet to be QoS-measured (steps 
15 S46 and $48). only when it is to be oos-measured (X£S at step 
S4 7, S48), the packet is output to the feature extractor 715, 
724. 

The feature extractor 715 extracts features as shown in 
Fig. OC from the right- transfer packet passing the packet 
2i) discriminator 713 (step S49). The feature extractor 724 

extracts features from the left-transfer packet passing the 
packet discriminator 723 (step S50) . The extracted features of 
the right -transfer packet and the current time stamp are output 
as lealuits dala Lu the xiyh I - Lrausf ex packet data buffer 736 
nf the fpatnre matching section 731 (steps S51. S53) . The 
extracted features of the left-transfer packet and the current 



2001 10/26 FRI 17:48 FAX 03 3288 3222 Ktsuragi Patent -» 0STR0LENK 



©019/041 



FQ5-565 4 J 

time stamp are output as feature data to the lett-transter packet 
data buffer 737 of the feature matching eection 731 (ctepe S52, 
S54). 

On the other hand, as described before, the feature data 
5 receiver 732 receives feature data from edge measuring probes 
at inflow locations via th« monitoring network 70 (stp.p S55)- 
The received feature data is stored in the inflow packet data 
Dutter V3!> (steps S56 and SJ>7). 

The feature matching ccction 731 compares the inflow 
10 packet reature data witn each of the riqnt-transt er packet 
feature data and the left -transfer packet feature data to detect 
a matching pair (step S58) „ When a right/left- transfer matching 
pair is found (YRS at stp.p SS9), thft QnS measuring section 733 
detects a transmission delay time from a difference between the 
15 time stamps of the matcning pair to compute uos information ( step 
S60) . Thereafter, the QoS information sender 734 sends the QoS 
information to the upper QoS manager 50 via 

the monitoring network 70 (step S61, S63). At the same time, 
the feature data of the matching pair is deleted from the packet 
20 data buffers 735-737 (step S62). 

When no matching pair is found (NO at 3tcp S59) , the buffer 
registration time is checked (step S64) . When the feature data 
stays in the inflow packet data buffer 735 after the in-buffer 
lifetime expixes (YES at step S65 and YES at step S66) , a packet 
?5 loss event notification is created (step S67) and thp. fp.afnrp. 
data is deleted from the inflow packet data buffer 735 (step 



□ 
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S69). The packet loss event notification is sent as uos 
information to the upper QoS manager 50 (step S70). When the 
feature data stays in the right -transfer and left-transfer 
packet data buffers 736 and 737 after the in-buffer lifetime 
5 expires (YES at step S65 and NO at step S66), an exception 
event notification is created (step S68) and is sent as QoS 
information to the upper QoS manager 50 (step 370) after the 

feature data is deleted irom the pacxet data Dutters 736 ana 
737 (step S69), 
10 The above -described steps S58-S70 are repeatedly 

performed until the buffers are empty (step S71). 
Example II 

According to thp. second *xampl « of th* fourth embodiment, 
a edge measuring probe performs time comparison to compute 

15 individual delay times . The edge and core measuring probes will 
be described with reference to Figs. 16 and 17, respectively. 

1) Edge measuring yrobe 

Referring to Fig. 16, an edge measuring probe 800 is 
provided with an inflow packet processor 810, an outflow packet 
20 processor 820, a QoS processor 830, a control processor 840. 
and a captured packet discrimination data 314- The Inflow 
pacKet processor 810, the outflow packet processor 820, and the 
control processor 840 are similar to the inflow packet processor 
610, Urn uuLfluw paukel processox. 620, and Hie coulxul processus 
640. *s shown in Fig. 13. respectively. Accordingly, thp> 
detailed descriptions will be omitted. 
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The uos processor 830 processes lntormation ot a captured 
outflow packet, inflow information of that captured packet at 
an edqe measuring probe, ana via-pomt information at 
core measuring probes to produce a QoS measurement of the 
5 COJClespOuCliiig packet fluw. The QuS piocessui 830 includes a 
feature matching section 831, a feature data receiver 832, a 
QoS measuring section 833, and a QoS information sender 834. 
The feature matching section 831 includes a plurality of inflow 
packet data buff era 835, a plurality of outflow packet data 
]* 10 Duffer 836, ana a plurality of via-pomt-x packet data Duffers 

f a* 

F% 837-839, whdro x - 1 , 2, n. 

m 

-J The feature data of inf luw/via-poin L-x/uu If low packets 

are distributed among th« plurality of inf low/via-point- 
O x/outflow packet data buffers depending on destination and 

Mi Id source addresses, application class and the like ot an 
ni inf low/via-point -x/outflow packet. The amount of feature data 

« }^ 

'!J for each buffer can be reduced and the feature matchinq is 

U 

performed by comparing the feature data of an inf low/via-point-x 

packet data buffer with that of a corresponding outflow packet 
20 data buffer. ThArAforA, thA amount of fAatnrA data to bA 

compared becomes smaller, reaulting in faster and more 

reliable matching operation. 

Further, according to thic example, the feature matching 

is performed by first comparing the feature data of an inflow 
25 packet data buffer with that of a corresponding outflow packet 

data buffer and then sequentially comparing the feature data 
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of via point-1 to point-n packet data buffers with the fe.atnr« 
data of the matching pair. In the case where the via point - 
1 to point-n represent a sequence of core measuring probes 
through which the packet passes, such feature matching method 
j can avoid causing the f eature matching operation to start before 
the packet in question exits from the egress due to network 
transmission delay or the like. 
2 j Core measuring nrohp. 

Referring to Fig. 17, a core measuring probe 900 according 

M 10 to the fourth embodiment is provided with a network transfer 
□ packet processor 910, a network transfer packet processor 920, 

^ 9 a control processor 940 , a captured packet discrimination data 



□ 



914, and a network configuration date 917. 

The network transfer packet processor 910 processes 
13 transit packets in the direction from the network 10_1 to 
the network 10_2. The network transfer packet proccsoor 910 



2 includes a packet capturing section 911, a time stamper 912, 



a packet discriminator 913, a feature extractor 915, a 

deb Liiidtiun dibcrimiiidLor 916, and a feaLuxts daLa seudex 916. 

30 Similarly, the network transfer packet processor 920 includes 
a packet capturing section 921, a time stamper 922, a packet 
discriminator 923. a feature extractor 925, a destination 
dicoriminator 926, and a feature data sender 928. 

Each of the packet discriminators 913 and 923 searches 

25 the captured packet discrimination data 914 to determine whether 
a captured packet is a packet to be QoS-measured. Only when it 
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is to be Oo$-measured, the captured packet is output to a 
corresponding one of the feature extractors 915 and 925. Each 
of the destination discriminators 916 and 926 uses the 
destination information of the captured packet to search 
5 the network configuration data 917 for the destination address 
of an edge measuring probe at an outflow location of the 
entire network (here, edge measuring probe 31a or 31d) . The 
other processing sections operate as described before. 

3) Operation of edge measuring probe 
10 An operation of the edge measuring probe will be described 

with reference to Fig, 18. 
U Referring to Fig, 18, when an outflow packet is captured 

by the packet capturing section 821 (step S71) . the time stamper 
822 stamps the outflow packet with the current time 3tamp (step 
15 S72). Thereafter, the packet discriminator 823 searches the 

captured packet discrimination data 814 to determine whether 

HO the outflow packet is a packet to be QuS-meaauxed (ateya S73 

□ 

it* and S75) . When it is to be QoS-measured (YES at step S74) . th* 

feature extractor 023 extracts features from the outflow packet 
20 passing the packet discriminator 823 (step S75) . The extracted 
features of the outflow packet and the current time ctamp are 
output as feature data to the outflow packet data buffer 836 
of the feature matching section 831 (steps S76 and S77). 

On the utliei. hand, the leatuxc data receiver 832 receives 
7> fp.atnrp data from p.rigp anri rorp mpa.qnring probp.fi. Morft 

specifically, when feature data has been received from an 



Mb 
S3 
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edge measuring probe (step S78), the received feature data is 
etored in a selected one of the inflow packet data buffers 835 
as described before (steps S79 and 80). When feature data has 
been received from a core measuring probe at a via point- 1, for 
5 example, the core measuring probe 31b, (step S81) , the received 
feature data is stored in a selected one of the via-point-1 
packet data buffers 837 (steps S84 and 87). Generally, when 
feature data has been received from a core measuring probe at 
a via point -x, where x = 1, 2, ~> n, (etepc S81-S83) , the received 

10 feature data is stored in a selected one of the via-point-x 
packet data buffers (steps S84-S89). 

Thereafter , the feature matching section 831 compares the 
feature data nf the selected inflow packet data buffer 835 with 
that of a counterpart of the outflow packet data buffers 836 

15 to detect an inflow-outflow matching pair (step S90) . When the 
inflow-outflow matching pair is found (YES at stop S90) , tho 
featuie matching section 831 sequentially compares the feature 
data of via point-1 to point-n packet data buffers with the 
feature data of the inflow-outflow matching pair (step S92). 

2(1 As described before, such feature matching method can avoid 
causing the feature matching operation to start before the 
packet in question exits from the eqress due to network 
transmission delay or the like. 

When a uiaLchiay pair is fuuud in all via-puiiil packet 

7> hnffp.rs fm-ft7Q (YES at stpp S<n), thp. QnS measuring section 
833 detects a transmission delay time from a difference between 



2001 10/26 FRI 17:50 FAX 03 3288 3222 Ktsuragi Patent - 0STR0LENK 



KJ5-565 49 

tne tune stamps of eacn matenmg pair to compute Qos information 

(stop S94) . Thereafter, th© QoS information sender 834 sonde 
the QoS information tu the upper QoS mauayex 50 vid 
the. monitoring network 70 (step S95. S99). At the same time. 
5 the corresponding feature data is deleted from the packet data 
buffers 835-839 (step S98). 

When no matching pair i3 found in at least one via-point 
packet buffer (NO at step S93). the Qos measuring section 833 
detects a transmission delay time from a difference between the 

10 time stamps of each matching pair to compute QoS Information 
(step S96) and create QoS information notification including 
via-point data loss information. Thereafter, the QoS 
information sender 834 sends the QoS information to the upper 
QoS manager 50 via the monitoring network 70 (step S99) . At the 

15 same time, the corresponding feature data is deleted from tne 

packet data buffers 835-839 (step S98). 

When no maLchiny paix is found (NO at step S91) , Lhe buffer 
regi strati on time i s checked (stepSlOO). When the. feature d*t<* 
stays in the inflow packet data buffers 035 after the in-buf fer 

2V lifetime expires ( yes at step sioi ana *jss at step Si02). tne 
feature matching section 831 sequentially searches via-point-x 
packet data buffer for feature data identical to the 
lifetime-expired data (step S103). A packet loss 
event notification is created (step S104) and the feature data 

25 is deleted from thA hnffftrs (<?t*p S1 10). The. packet loss 
event notification is sent as QoS information to the upper 
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oos manager so (step sUi). 

When the feature data etaye in the outflow packet data 
buffers 636 after the in-buff er lifetime expires (YES at step 
SlOl , NO at step S102 , and NO at gtep S105 ) , the feature matching 
5 section 831 sequentially searches via-point-x packet data 
hnffe.r for fe*tnr* tf*ta identical to the 1 i ffctima-fcxpired data 
(step S106). An exception event notification is created (step 
S107) and the teature data is deleted from tne data buffers (step 
SllO). The exception event notification is cent as QoS 
10 information to the upper Qos manager 50 (step sill). 

When the feature data stays in the via point-x packet data 
buffers af Lex the in-buff er lifetime expires (YES at step SlOl, 

NO at stAp S102, and YKS at sfftp S1 05), th* fftatnrft matching 
section 831 sequentially searches the inflow, outflow, and 
15 via-point-x pacKet data buffers for teature data identical to 
the lifetime-expired data (step S108). An exception 

y| event notification is created (step S109) and the fealuxe data 

*** 

H is deleted from the data buffers (step SllO). The exception 

event notification is sent as QoS information to the upper 
20 QoS manager 50 (step Sill). In this manner, the steps S100- 
Sill can avoid increasing an amount of feature data in each 
buffer and increasing the time required for feature matchinq. 

The above -described steps S90-S111 are repeatedly 
pexfuxnied uulil Lhe buffexs axe emyLy (step S112). 
?5 &s described above. QoS in-Formation can hp. ohtainp.d from 

feature data not only at the ingress and egress but at via- 
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point locations including interconnection points between 
different networks. Accordingly, QoS information of the 
entire network from the ingxess to the egress including an 
external network not under QoS measurement and sub -QoS 
5 information of each network included in the entire network can 
be measured. 

Since the sub -QoS information of each network included 
in the entire network can be measured, in the event of reduction 
in QoS of the entire network due to a larger amount of delay 
10 time or loss of packet, a bottleneck causing the QoS reduction 
can be identified. 

In the above -described embodiments, QoS information is 
delay time of a user's IP packet. Loss of packet ratio, bandwidth 
occupation ratio, number of packets or packet bytes in unit3 
15 of time , or the like . The bandwidth occupation ratio is obtained 

by dividing an accumulated number of packet bytes for a unit 
of lime by the capacity uf a communication line. 



